Scientific understanding is a fundamental goal of science. However, there is currently no good way to measure the scientific understanding of agents, whether these be humans or Artificial Intelligence systems. Without a clear benchmark, it is challenging to evaluate and compare different levels of scientific understanding. In this paper, we propose a framework to create a benchmark for scientific understanding, utilizing tools from philosophy of science. We adopt a behavioral conception of understanding, according to which genuine understanding should be recognized (...) as an ability to perform certain tasks. We extend this notion of scientific understanding by considering a set of questions that gauge different levels of scientific understanding, covering information retrieval, the capability to arrange information to produce an explanation, and the ability to infer how things would be different under different circumstances. We suggest building a Scientific Understanding Benchmark (SUB), formed by a set of these tests, allowing for the evaluation and comparison of scientific understanding. Benchmarking plays a crucial role in establishing trust, ensuring quality control, and providing a basis for performance evaluation. By aligning machine and human scientific understanding we can improve their utility, ultimately advancing scientific understanding and helping to discover new insights within machines. (shrink)

Science has not only produced a vast amount of knowledge about a wide range of phenomena, it has also enhanced our understanding of these phenomena. Indeed, understanding can be regarded as one of the central aims of science. But what exactly is it to understand phenomena scientifically, and how can scientific understanding be achieved? What is the difference between scientific knowledge and scientific understanding? These questions are hotly debated in contemporary epistemology and philosophy of science. While philosophers have long regarded (...) understanding as a merely subjective and psychological notion that is irrelevant from an epistemological perspective, nowadays many of them acknowledge that a philosophical account of science and its aims should include an analysis of the nature of understanding. This chapter reviews the current debate on scientific understanding. It presents the main philosophical accounts of scientific understanding and discusses topical issues such as the relation between understanding, truth and knowledge, the phenomenology of understanding, and the role of understanding in scientific progress. (shrink)

This is a collection of high-quality research papers in the philosophy of science, deriving from papers presented at the second meeting of the European Philosophy of Science Association in Amsterdam, October 2009.

Scientific understanding is a fundamental goal of science. However, there is currently no good way to measure the scientific understanding of agents, whether these be humans or Artificial Intelligence systems. Without a clear benchmark, it is challenging to evaluate and compare different levels of scientific understanding. In this paper, we propose a framework to create a benchmark for scientific understanding, utilizing tools from philosophy of science. We adopt a behavioral conception of understanding, according to which genuine understanding should be recognized (...) as an ability to perform certain tasks. We extend this notion of scientific understanding by considering a set of questions that gauge different levels of scientific understanding, covering information retrieval, the capability to arrange information to produce an explanation, and the ability to infer how things would be different under different circumstances. We suggest building a Scientific Understanding Benchmark (SUB), formed by a set of these tests, allowing for the evaluation and comparison of scientific understanding. Benchmarking plays a crucial role in establishing trust, ensuring quality control, and providing a basis for performance evaluation. By aligning machine and human scientific understanding we can improve their utility, ultimately advancing scientific understanding and helping to discover new insights within machines. (shrink)

This paper examines how scientific understanding is enhanced by virtual entities, focusing on the case of the synthetic cell. Comparing it to other virtual entities and environments in science, we argue that the synthetic cell has a virtual dimension, in that it is functionally similar to living cells, though it does not mimic any particular naturally evolved cell (nor is it constructed to do so). In being cell-like at most, the synthetic cell is akin to many other virtual objects as (...) it is selective and only partially implemented. However, there is one important difference: it is constructed by using the same materials and, to some extent, the same kind of processes as its natural counterparts. In contrast to virtual reality, especially to that of digital entities and environments, the details of its implementation is what matters for the scientific understanding generated by the synthetic cell. We conclude by arguing for the close connection between the virtual and the artifactual. (shrink)